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ABSTRACT 


This report introduces the two-dimensional transform used in the 
research TV source encoder, RM2. It is shown that both conceptually and in 
terms of the number of required computations, the RM2 transform is consider- 
ably simpler than the Fast Hadamard Transform. The latter can in fact be gen- 
erated by extending the RM2 transform. 
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I. INTRODUCTION 


This report provides details of the two-dimensional transform used in 
the research TV source encoder, RM2. For the uninitiated reader, adequate 
background is provided for the main topic which is carried as far as some 
implementation considerations. 

It is shown that, both conceptually and in terms of the number of required 
computations, the RM2 transform is considerably simpler than the Fast 
Hadamard Transform (FHT). In fact, it is demonstrated in the Appendix that 
the FHT can be generated by extending the RM2 transform. 

Previously, the FHT had generally been considered the simplest trans- 
form having practical applications to TV source encoding. The demonstration 
that the simpler RM2 transform can be made quite powerful when combined with 
other techniques will be the subject of subsequent reports. The reader may 
consult the extensive bibliography by Wintz^ to see what others have done 
using transforms for TV source encoding. 
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II. BASIC TRANSFORM 


* 


The standard representation for an arbitrary N by N matrix X with 
elements a„ is given as linear combinations of the N basis vectors 


e. . 
ij 


o : o 


0 


---0 0 1 0 0 — 
0 
0 

0 * 0 


(i) 


That is 


■ £ 


r \j 

a, . e. * 

ij ij 


i > j 


U) 


The e„ are said to span the N" dimensional space and are called basis vectors. 
The scalar product for two arbitrary vectors in this space is defined by 




■ £ 


< A, B>= y a. . b. . 

‘ ij ij 


( 3 ) 


J 


The norm of a vector is given by 


II A || = «A, A»^ 


(4) 


'‘Only the most basic abstract algebra is involved here. The reader is 
referred to the introductory chapters of Ref* 2 for more details. 
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If<A, B> = 0, A and B are said to be orthogonal. If in addition 
[| A || = || B || = 1 they are orthonormal. One can easily verify that the 
e,. form an orthonormal set. Also <A, e..> = a., so that 


A 



e. .> 
ij 




e. , 


( 5 ) 


It is a consequence of vector space theory that any set of N orthogonal vectors 
Hq, Hj, . . . j span the space so that we can write 


A 



Ay A. 


< A’ V 


k 



( 6 ) 


Thus, we see that (5) is just a special case of (6). 

Now turning to the simplest non-trivial case of N = Z, consider the 

[3] 

Hadamard set of orthogonal basis vectors 

s o - >/ 4 [l l] 5 i = >/ 4 [l : l] 

(7) 

S 2 = 1 / 4 [.!'!] S 3 = 1 / 4 [-!-!] 

The reader may verify, using (3) and (4) that |j IT j| - l/2 so that we can 
write 


A 


4 


Z Ay A/ Ay 

<A , H k > H k 


( 8 ) 
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"V 

Now the first term, A = <A, > , is simply the average of the four elements 


of the array A. Thus, if the other terms were deleted or set to zero, we would 
have a new A 1 which has all four elements equal to the original average. A, 
Adding back in the deleted terms one by one, we see that these coefficients, 

'V '“V> 

< A, H.>, tell us how much the array tends towards H., from the all constant 

'V- ^ 'V> 'V* S\s 

array. For example, suppose < A, > = 1, <A > = <A, > = 0. 

Using (7) and (8), we get 


A 


A + 1 
A + 1 



(9) 


These operations can also be interpreted as a linear transformation of the 

f\j 

vector A into another vector C. First rewrite A as 



Letting denote this transformation 



a Q 

T 

22 

rv, 

<A, H 0 > 

r~ 

A 

r-H 

V 

r\. 

o 

o 

C 1 

A = 

_ a 3 a 2_ 


< A, H 3 > 

<A , H 2 > 

= c = 

_ C 3 

C 2 


In terms of matrix multiplication, we can write 

/ \j 

C = 1/4 W A W . (11) 

r V< 

Where W is the 2 by 2 Hadamard matrix 


W 


1 1 
1 - 1 
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Noting that WW = 21 where I is the identity matrix, we get the inverse 
defined by 


'V 'V 'Vi 

A = W C W . (12) 

Thus, other than for a factor of 2^ (essentially free in a digital system), the 
inverse requires the same operations. 

Let us consider these steps in more detail. Assume we start with 5 
registers Xq, X^, .... X^ with the first four initially loaded with the corre- 
sponding coefficients, a^ if transform, c^ if inverse. These steps are, 
enumerated in Table 1. At completion, requiring 8 additions, the four regis- 
ters contain the desired result, transform or inverse. 

The basic transform T^ described in Table 1 is really the Fast Hadamard 
f 3 1 

Transform for the simplest case of an array of size 2 by 2. We have dis- 
cussed it in detail because it forms a fundamental part of what follows. More 
involved operations will be avoided by repeated usage of T^* 
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Table 1. T^ Op era ti° ns 


Operation 

Register Contents 

x„ 

a r 

0 

0 

x i 

a i 

Initialize 

1 

X, 

o' 

Z 

Z 

X 3 

a 3 

X 0 + X 3 - X 0 

of 0 + “3 

X, + X, — X, 

a , + 

1 Z 4 

1 z 

X Z + x 3 - X z 

“2 + <, 3 

X 0 + X 4 - X 0 

« 0 + «1 + » 2 + « 3 

X ! + X 3 - X 3 

"l + "3 

X 0 * 2X 4 - X 1 

« 0 + « 3 - («! + « 2 ) 

X 0 - 2X Z ~ X 4 

a 0 + “l - (« 2 + « 3 > 

X 0 " 2X 3 ^ X Z 

“0 + “2 - <“l + “3 1 

X 4^ X 3 

“0 + “l - ( “2 + a 3> 

Shift X^ right Z places if transform. 
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III. HIGHER DIMENSIONS 


Assume that our source data to be coded has been loaded into an array 
J J ~ J 

of size 2 by 2 which we denote C^. The most obvious way to use T 7 ^ i n 


coding the source data is to apply it separately to each of the Z 

,2J-2 


2J-2 


two by two 

subarrays. In this case, we would end up with coefficients of each type 

Cq, c r c £ , and c^ (see (10)). For the moment, let us assume these are 
separately placed in four arrays of size 2^ ^ by 2^ * (in their same relative 


location) and denoted respectively by C. , i = 0, 1, 2, 3. An example to 
clarify this is shown below for J = 2 (Fig. 1). The additional notation is 
self-explanatory. 


; J - 1 ~ J- 1 

'1 ’ °2 


The coefficient sets ", ", " repre sent data sources which 


iJ-1 

'3 


are quite similar statistically in terms of their effect on reconstruction. 
Statistically, they tend to be distributed about zero in a bell-shaped fashion. 


Their effect on reconstruction is to add back in detail to the constant (equal to 

~ j_ 1 

the average) two by two arrays represented by the terms. On the other 


: J- 1 


hand, the terms are quite different and so we direct our attention there, 

^ j_ 1 ^ j_ i ^ J - 1 

leaving , and arrays as described. 

cl c! 



0 

a 0 

0 

a l 

t 

°0 

l 

a l 


0 

c 0 

0 

c ) 

1 

c o 

c ! 

DATA IN _ 

0 

°3 

0 

a 2 

a 3 

\ 

g 2 

APPLY 
T 22 TO 

0 

c 3 

4 

1 

c 3 

i 

c 2 


3 

3 

2 

2 

EACH 

3 

3 

2 

2 


°0 

°1 

°0 

°1 

2 BY 2 

c 0 

C 1 

c 0 

C 1 

i 

3 

°3 

3 

°2 

2 

a 3 

2 

°2 


4 

4 

2 

c 3 

2 

c 2 


0 

c 0 


4 


0 

1 

c ) 

c ] 

3 

2 

C 1 

c ! 


f 2 


l 

c 2 


Fig. 1. Illustrative Example 
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^ J- 1 

The Cq array contains two by two averages and thus statistically looks 

much like the original data except at one half the sampling rate in both dimen- 

~ j_ l 

sions. This leads us to apply again to all the two by twos in . We 

^J-2 ^ J - Z ^ J-Z ^ J- Z 

get four new arrays * Again, we can draw the same 

'yj _2 

conclusions, with containing four by four averages of the original data. 

We can now generalize. Let ^ denote the application of T^ to all 
two by twos of Cq , j = 0, 1, . . . , J-l. The collection of coefficients c.., 
i = 0, 1, 2, 3 are placed respectively in arrays ^ \ ^ \ ^ and 


cj-j - 1 


all of dimension 2^ ^ ^ by 2^ ^ Applying T^ ^ successively, j = 0, 


1 J-l c 


J-j-1 

0 


will contain the average value s of each 2^ + * by 2^* subarray 


of the original data array Cq. At termination, j = J-l, is a single term 
equal to the average of all elements of the original array. This process is 
best described by the diagram in Fig. 2. 

Number of Computations 

W r e are interested in the total number of additions or subtractions required 
to generate the arrays of Fig. 2. In Table 1, we showed that each use of 
requires eight and thus we need only determine the number of times T ?:? is used 
by T^, ^ (i.e,, the number of two by two 1 s in each ... of the 

Cq, k = 1, 2, . . . , J). Adding these terms, we have 2 2J \ 1/4 + (1/4) 2 + . . . 


(1/4)^} for a total number of calculations of 


n T = (8/3) { Z 2J - 1 } . 


(13) 


This compares with 2 direct calculations for the Hadamard transformation 
or (2J)2^ using the Fast Hadamard approach. For 64 by 64 arrays this means 
the new transform requires approximately 1/4 the number of calculations as 
the Fast Hadamard. 
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Basis Vectors 


J J 'V J 

The 2 by 2 input vector A entered into in Fig. 2 can be represented 

in terms of an expansion of the form (6). In fact, the expansion of Fig. 2 

Z J 'V -V 

actually generates the 2 coefficients, <A,H^>, although we have not 

'V 

explicitly exhibited these basis vectors, H . This topic may prove to be of 
interest to some and leads to an interesting relationship with the Fast Hadamard 
transform. However, in order to avoid introducing unnecessary complications 
into the main thrust of this paper, we defer this subject to the Appendix. 
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IV. ADDRESSING 


The following discussion should be particularly useful in software 
implementations of Fig. 2 using higher level languages such as Fortran (and the 
Fast Hadamard in the Appendix). 

Assume that array Cq is a 2^ by 2 random access memory initially 
loaded with source data in the same pattern as it appears visually. The 
standard two dimensional address of any element a^ is, of course, defined by 
the row number i and the column number j. 

'Vi- 2 k. 

Now the arrays C. correspond to Z memory locations. The operation 


T k on Cq produces four new' arrays 1 , C^ 1 , and *, each requir- 

ing 2^ 1 ) memory locations. Since is no longer required, no new memory 
is actually required. Since this is true for each k, we can, by suitable 

'b J 

addressing, use the input memory for all coefficients generated. 

Consistent with our labeling of coefficients, we label the quadrants of 
any square array by the arrangement: 

G-i-3 

~ J 

Clearly, the location of an element a^. which lies in Cq is uniquely specified by 
giving J quadrant numbers (e.g. , which quarter of the 2 J by 2 J array, which 
quarter of the by 2 J_1 subarray and so on). We need only to relate these 

quadrant numbers to row and column numbers i and j. 

Let kj , j? = 1, 2, . . . , J denote the quadrant of the subarray of size 
2^ by 2^ in which a^ resides. Define 


U(X) = 


1 if X mod 4 > 1 
0 otherwise 
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Then we can write the row and column addresses 


i = 1 + 


J 

E 

t = 1 


t _ 1 

2 U(k^) 


( 16 ) 


E 

i = i 


z*' 1 U (k + 1) 


The first application of T J in Fig. 2 requires that for each value of k 2 , 

• • • > we apply T 22 to the four numbers obtained by setting k^ equal to 0, 1, 

2, and 3. The results are returned to the corresponding locations so that the 
2 2 * J coefficients of C^" 1 reside in all i, j locations satisfying (16) with kj fixed 
at 0, 1, 2, or 3. 

The application of T J_1 to C^' 1 requires that we fix k = 0 and then for 

each value of k^, • • m » kj we a PPly the four numbers obtained by 

setting k^ = 0, 1, 2, and 3. At completion, the 2 2 ^ 2 ^ coefficients of c/" 2 reside 

k 2 

in all x, j locations satisfying (16) with k fixed at 0, 1, 2, or 3 and k. = 0. 

^ 1 

In general, the application of T J_i to requires that we fix kj = k 2 = 

... = kj = 0 and then for each value of k^ +2 , . . . , kj we apply T 22 to the four 

numbers obtained by setting k i+J = 0, 1, 2, and 3. We get the 2 2(J ' £_1) 

coefficients of C, located in all i, j locations satisfying (16) with k 

f + 1 f + 1 

fixed at 0, 1, 2, or 3 and k. = k_ = . . . = k =0. 

12 f 

Clearly, we can at any time retrieve desired subsets of coefficients for 
coding purposes, simply by observing these constraints imposed on the j k ) 
and on the i, j through (16). 
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V. SHIFT REGISTER IMPLEMENTATION 


Figure 3 exhibits another way of looking at the construction of Fig* 2 
utilizing shift registers* 

~ J 

Starting at the leftmost part of Fig. 3, input samples of C Q are clocked 
into the processor T line by line at some sample rate t . The first line, and 
subsequent odd-numbered lines, enter the 2^ sample shift register SRj. These 
samples are combined in pairs with the corresponding samples from the 
following even-numbered lines to form two by two input arrays which are then 

processed by T . Clearly, each pair of odd and even lines generates one 

~ T 1 'V J 1 

line of the arrays Ci ' ,1 = 0, 1, 2, 3. In particular, the lines of C 0) 

sequentially enter processor T^" 1 which performs functionally in the same 

manner as to produce the arrays cf j = 0, 1, 2, 3. However, the input 

sample rate to has been quartered and the shift register storage reduced 

in half. 

'v. t _ k J-k -2k 

Generalizing, odd lines of enter T at a sample rate 2 . t^. 

J-k 

These samples are temporarily stored in a 2 sample shift register, SRj 
Samples from SRj ^ are combined in pairs with the corresponding samples 
from the following even lines to generate two by two arrays. T ^ is applied to 
each two by two array to generate, line by line, the coefficients of arrays 
j = 0, 1, 2, 3. 

Observe that the generation of all coefficients of all arrays is completed 
almost simultaneously with the entry of the last data sample into T . The delay 
is approximately the time required for J uses of T^. 


*The same arguments hold with a column by column structure. 
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Fig. 3. A Shift Register In 





appendix 


MORE ON THE TRANSFORM 

BASIS VECTORS 

We start out by Labeling the coefficients in the arrays of Fig. 2. In 

'-y a Oj fj 

particular, for the 2 elements of Ch number them row by row using the 
additional notation c.(k) to indicate the kth coefficient of C. • Here k — 1, 2, 

J J 

. . . , 2 l in the first row, k = 2 l +1, Z l +2, . . . , 2* +1 in the second row and 

?C J _ 0 J -ft 

so on. Similarly, we label the 2 subarrays of size 2 by 2 residing in 
an array of size 2 J by 2 J (e. g. , C J ). This labeling establishes a one to one 
relationship between any coefficient of C. and the area over which it has influ- 
ence in the input array C^. It is this one to one relationship which is important, 
the particular labeling was chosen for convenience. An example is shown 
below for an input array of size 2 J by 2 , and subarrays of size 2 by 2 . 



INPUT 64 BY 64 ARRAY C$! WITH 8 BY 8 COEFFICIENT ARRAY C? WITH COEFFICIENTS 

SUBARRAYS LABELED LABELED J 


Fig. A-l. Coefficient and Subarray Labeling 
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Let Sq denote the 2 2 ^ dimensional vector space spanned by the standard 
basis vector s e.j in{l). Now let Sq ^ be the 2 2 ^ 2 dimensional subspace of 


0 


spanned by the orthogonal vectors 


V^'V), V^ _1 (2), ... , vJ' 1 {2 2J_2 ). 


0 


(A- 1 ) 


~j_ i J J 

where 4 • V Q (k) is a 2 by 2 array containing I's in all four positions of the 

Aj T _ 1 

kth two by two and zeroes elsewhere. For example, Vq (2) is given by 


•v T- 1 

VX *(2) 


= 1/4 


0 0 110 0 
0 0 110 0 
0 0 0 0 0 0 


0 0 
0 0 


0 0 
0 0 


0 0 
0 0 


(A- 2) 


We can similarly define subspaces j = 1, 2, 3 spanned by the orthogonal 

| v7 ^ (k) | where 4 • ~ ^ n, \ j a -.J 


vector sets 


\ (k), 4 • (k) and 4 • V^ _1 (k) are 2^ 


by 2 arrays with 


[Li] • [-!'!] and [-1-!] 

respectively in the kth two by two and zeroes elsewhere. We note that all 
vectors are orthogonal with a norm equal to l/2. 

If we now take the scalar product of these vectors with the input vector 
A we find 


~ ^ T_ i T 1 

< a, vr (k)> = C J . V) 


(A-3) 
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Therefore, we can write 


A = 


4 



T_ 1 ~T- 1 

Cj J Nk) Vj A (k) 


(A-4) 


J - 1 * • ^ 

Now specifically consider the subspace . The projection of A onto this 

subspace is simply the j = 0 terms in (A-4). We wish to represent this subspace 
in terms of a new set of basis vectors. Let 2 be the 2 2 ^ ^ dimensional 
subspace of Sq ^ spanned by the orthogonal vectors 


;J-2, 


,J-2, 


-J-2 ro 2J-4 


Vj "(1), V u 0 (2), ... , VJ (2 


). 


(A - 5) 


^ T-? T J 

where 16 • V n (k) is a 2 by 2 array containing l's in all 16 positions of the 


kth four by four and zeroes elsewhere. Similarly, we define subspaces 

f^J-Z ) ^ J -2 

j = 1, 2, 3 spanned by the orthogonal vector sets | V\ (k)| where 16 • (k), 

lb-V^^k) and 16 • 2 (k) are 2^ by 2^ arrays with 


J-2 


1 

1 

- 1-1 


1 1 

- 1-1 


1 1 

1 1 

1 

1 

- 1-1 


1 1 

- 1-1 

and 

1 1 

1 1 

1 

1 

- 1-1 

t 

- 1-1 

1 1 

- 1-1 

- 1-1 

1 

1 

- 1-1 


- 1-1 

1 1 


- 1-1 

- 1-1 


(A- 6) 


respectively in the kth four by four and zeroes elsewhere. We note that 

|[v?‘ 2 (k)|| = l/4 and <A, V J ~ 2 (k) > = c?" 2 (k). Therefore, the projecti 
J J J 

~ j_ i 

of A on Sq in (A-4) can be replaced by 

3 


on 


16 


z z<r^r*> 


(A- 7) 


j=0 
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The pattern should be established now. We continue to break up each 
orthogonal subspace ^ into four new orthogonal subspaces 

\ and Sj * 1 until ^ contains only one vector, Vq( 1), where Z 2 J Vq( 1) 
is the all 1* s array. Then our original input array A can be written as 


3 J 


,2J 0... 30,.. , 

2 c o (1) v o (1) + 


j=l <=1 


( E«J 

l k . 


(k ) V J_i (k ) 
J £ j £ 


(A - 8) 


A RELATIONSHIP WITH HADAMARD 

In this section we demonstrate that the RM2 transform, using ^ 22 ’ can be 

extended to generate the FHT. 

[3] 

Hadamard Transform L 

First consider the standard Hadamard matrix of size two by two, given 
earlier as 


H 1 - 1 1 

H " 1 -1 


(A-9) 


In general, given the 2 by 2 m Hadamard matrix H m , we can get H m+ ^ 
by the construction 


H m + 1 


~m 

1 

H 

I H 

1 _ 

rym 

1 T ^m 

H 

i -H J 


(A- 1 0) 


The 2 rows (also the columns) of H contain only +1' s and -l*s. The 
number of sign changes along a row (or column) is usually called "sequency”. 
Each row has a different sequency number ranging from 0 to We can, 

thei efore, conveniently use this sequency number to label the 2^ distinct row 
(and column) vectors thus generated. Let r m (i ) denote a column vector equal 

y y H 

to the column of H with sequency i . Similarly, let r m (i ) denote a row 

y x x 

vector equal to the row of H with sequency i . 
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The 2^ m Hadamard basis vectors (2 m by 2 m arrays) are formed from 
the dyadic products 


h (1 , 1 ) = r (1 ) r 1 
v x y' y y x x 


The reader may verify that 


x,. \ 
r 1 

y v y' 

L \ J 


m . 
r l ) 
x x 


(A-ll) 


h\o,0) 


4 H, 


~1 

M1,0) 


~ 1 

Ml, i) 


<v 

4 H, 


4 H„ 


(A- 12) 


-V 1 

MO, 1) 


4 H„ 


m 

where the were given in (7). The h (i^, i 
dividing by 2^ m 

Returning to the construction in (A- 10), 
of H m , then both 


) can be made orthonormal by 


we note that if r m (i ) is a column 

y y 



m,. \ *" 
r (l ) 

y j y 


m 

r 


and 

r 

y 

j 


m,. \ 

y y 


m 

-r 

y i 

<v 


. 1 . 


\ 



(A- 13) 


are column vectors of H .A similar conclusion holds for the rows, 


if X = h (i , i ) is a Hadamard basis vector for the space of 2 by 2 
x y 

then 


Thus, 

matrices, 



<?x 


- O/ 

X 

I 

^x 

1 


r ^ 

X 

1 

i 


1 

Xe 



y 



) 

'V. 

*\j 

and 



X 

xj 


X 

-X J 


.-x 

X . 


L-x 

-x J 


are Hadamard basis vectors in the space of 2 m + l by 2 m + l matrices. 


(A- 14) 
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The Fast Hadamard from 

Define ^ (k ), = 1 , 2 ,..., ^ as the subspace of all linear 

combinations of e.. which have components in the subarray of size 2^ by 

1 *. 

For the simplest case, divide S'J into 2^^ ^ orthogonal subspaces, each 
of dimension 4, 


S J 0 n E J_1 (1) 

sJnE J_1 (2) (A- 15) 


n e j ' 1 ( 2 2(j ‘ 1) ) 


Without loss of generality, choose E 1 ^ ^(1). This subspace consists of 

four 2^ by 2^ arrays u^, u^, u^, and u^ corresponding to e^, ®1Z’ ^22’ ®21 
respectively. We can represent these vectors by 





1/2 

1/2 

1/2 

1/2 


'V. 

(u o 

+ u l + u 2 

+ u 3 ) 




'■o 

(u o 

+ - Uj 

- u 2 } 

'*'L# 

'V 

'Vr 


(u o 

+ "2 - U 1 

- u 3 ) 


<"o 

'*U 


(u Q 

+ U 1 - u 2 

- u 3 ) 


(A- 16) 
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If we wish any scalar product <A, v^> we have from (A- 16): 


CA, v k > 



<-\j f\, f\s *\j (\f *Vr ''Vc 

< A, u^ > ± < A, u^ > ± < A, u^> ± < A, u^> 


(A - 17) 


or more simply, we apply 2 ' using Table 1. 

From previous discussion, we see that the four non-zero positions of 
Vq, and v^ are the normalized Hadamard basis vectors for two by 

twos. Clearly, this is true for all the subspaces in (A- 15). 

Now form four orthogonal subspaces: 


s o s o 


S 1 s o 


5 A 


S 3 S 0 


(A- 18) 


T 'V 

where S. S„ consists of all linear combinations of vectors of the form v. 

h 0 h 

1 . J“ 1 J- 1 J- 1 J- 1 1 

generated in (A-16). We recognize these as , and 

respectively by our earlier notation. 

Now divide each such subspace into 2^^ ^ orthogonal subspaces; 




-2 


= 1 , 2 , . . . , 2 


2(J- 2) 


(k 2 > 


(A- 19) 


j 1 = 0, 1, 2 , 3 


Each subspace contains four orthogonal vectors, each with the same two by 

two Hadamard basis vector in its non- zero positions (which are located 

th 

respectively in the four quadrants of the four by four). 
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r \j /\j 

Using u Q , Uj, u^,, and to represent these four vectors, we can again 

use (A- 16) to generate four new vectors which span this subspace. In particular, 

let X. be the two by two Hadamard basis vector corre sponding to each sub- 
J i 

space 



Applying {A- 16) to each subspace, we get 4 new orthogonal vectors whose non- 
zero positions are (except for a normalizing factor) given in (A- 14). Thus, we 
have generated four valid Hadamard basis vectors of size four by four. Now 
for a given (i. e. , a given 4 by 4), the four Hadamard basis vectors gener- 
ated must be distinct for each since otherwise the subspaces 

(%<%) OE J - 2 (k 2 ), n E J - 2 (k 2 ),< { jj 

could not be orthogonal. Therefore, this process has generated all of the 2 4 
Hadamard basis vectors for each k^. The scalar product of the input vector, 

«X» 

A, with each of the vectors generated for a fixed j ^ and k., is again obtained 
simply by a single application of 2 • T^. 

4 

Now form the 2 subspaces 

Sj S. S J 0 jj, j 2 = 0, 1, 2, 3. (A- 20) 

2 1 

where S. S. S~ consists of all linear combinations of the vectors 

J 2 J 1^ U 

formed using v in (A- 16) on the subspace S. S^. Let X. . denote the 

J 2 h ° J 2 J 1 

particular normalized Hadamard basis vector corresponding to non-zero 
locations of these vectors. 
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The pattern should be clear now. After the mth step, we have the 2* 
orthogonal subspaces 


^ m ^ m * 1 


• • % s 0 


(A-21) 


Where S. . . . consists of all linear combinations of 2? by 2? arrays, which 
1 0 


have Hadamard basis vector X. 


j 1 -. • • • J -i 


iach of the k " 1, 2, ,, 2* 


subarrays of size 2 by 2 , and zeroes elsewhere. 

We form the 2^^ m ^ orthogonal subspaces of dimension 4 


S. • 






(A- 22) 


k m + l " lf 2 > * * * ’ 2 


2( J-m- 1 ) 


We then represent each such subspace by four new vectors using (A- 16). Again 
by (A- 14) the non- zero positions of the new vectors are valid Hadamard basis 

m -j- J fYH -j- J 

vectors of dimension 2 by 2 and denoted by X. . . . Fixing 

J m + l J m"°l 

k this process must produce 4 distinct vectors for each value of j , 

m + 1 r * m 

j , . . . , ji since otherwise the subs pace s S, S. . . . could not be 
m-1 i J m J m - 1 u 

orthogonal. Thus, we have generated all the 2^ m + ^ orthonormal Hadamard 
basis vectors. The process continues until m = J. 

~ 2 J 

To obtain the scalar product of the input vector A with these 2 
Hadamard basis vectors requires one more application of 2 • T^ f° r each 
quadruple of vectors generated. We can now add up the total number of 
applications of T 

In the first expansion, there are 2^^ ^ subspaces requiring^ single 
application of 2 • T^ each. On the second step, we have 2^^~^ subspaces 
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for each of 2^ Hadamard basis vectors. In general, we have 2^^ - ^ subspaces 
2* S. 

for each of 2 Hadamard basis vectors. The process continues until 
i = J-l. Adding all these together and multiplying by the number of computa- 
tions per use {see Table 1), we get: 


[No. of 2 (J- 1 ) .2. 1 

computations] =2 [1*2 +2 


2 2 ( j - 2 ) + 


= (log 2 ZJ ) 2 2J . (A- 23) 

We recognize the latter figure as the number of computations required to 
generate the Fast Hadamard Transform. 
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